Transformers: Attention Is All You Need
Notes on the Transformer architecture: attention mechanisms, multi-head attention, positional encoding, and encoder/decoder layers with PyTorch implementations.
Content tagged with "generative models"
Notes on the Transformer architecture: attention mechanisms, multi-head attention, positional encoding, and encoder/decoder layers with PyTorch implementations.
A compilation of interesting papers I enjoyed reading, including I-Con, Denoising Diffusion Probabilistic Models, and SpiRobs.
Notes on the mathematical foundations of diffusion models, including the noising process, denoising process, loss function, and training/generation loops.